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How do we make data useful for decisionmaking? For eons, It seems, many of us 
a« evaluators have struggled with this Question. We as data producers and data lovers see 
great potential for our'^orts In Improving educational policymaking and fadlllatlng 
school Improvement. Legislatures too, particularly In California, seem to agree on the 
power of evaluative Information as they mandate school report cards, performance 
reports, and a full complement of tests. In the face of such optimism about the power 
of data, we see repeated evidence that the actual Impact of our work Is quite modest 
(Alkln, Dalllak, & White, 1979; Patton, 1986; Herman, 1987). 

Clearly, simply proclaiming the value of our work Is an Insufficient strategy for 
assuring that It reaches that potential, in an attempt to design more effective strategies, 
we at CRESST had a minor Insight: let's stop talking tc ourselves about the value of our 
work, let's stop talking about hypothetical Impact if people like us were In planning and 
decisionmaking roles In schools, and let's start talking and better understanding those 
who actually occupy those crucial roles In schools. We need to get Inside the heads of 
real school decisionmakers and better understand where our data fits Into their worlds. 
We need to design strategies that meet their needs, not our misconceptions about their 
needs. 

With these perspectives In mind, we embarked on Interview studies of school 
board members, superintendents, and school principals. Our questions were relatively 
simple: what sources of Information do these groups really use to judge the quality of 
their schools, what standards do they use to arrive at their judgments; how do they 
make sense of and use the formal test data they receive, and what are their preferences 
for report content and format. In the process of answering these questions, we also 
developed Interest In their basic affect toward and belief In testing. 

The research was the result of a unique collaborative project between the UCLA 
Center for Research on Evaluation. Standards, and Student Testing (CRESST) and 
participating district Research and Evaluation directors who conducted Interviews with 
decisionmakers within their local districts. It was a collaboration which had direct 
benefits for everyone Involved. In the process of doing Interviews, our colleagues 
gained visibility within their districts and the opportunity to better understand the 
needs of those they are supposed to be serving. And we gained key inforaiants wh.o are 
highly knowledgeable about local context and a very cost-effective data base about 
Information use in a wide range of Institutional settings. The nature of these settings 
and the specific methodology used In the project Is desalbed In the sections below, 
followed by a summary of results and their Implications. 



Methodology 

The MLES project's multldlsdpllnary ilteiature review and examination of district 
reporting practices were the basis for hypotheses about how principals use data In the 
real world and the variables which arc likely to Influence such use. These were the basis 
for the sample design and the Interview proto<:ol. 

The Interview Protocol 

The Interview protocol was developed to examine questions and variables of 
Interest and revised based on field test results. The final version had three parts: 

Pre-intervlew. The pre-lntervlew consisted of an Introduction, a statement of 
purpose, a description of the general content of the Interview, an assurance of 
anonymity, permission to tape the Interview, and solicitation of clarifying questions. 

Interview. The second part of the protocol contained the Interview questions. 
The questions concerned the sources, criteria and application of Information principals 



use to dissess the quality of education fn their schools. Other questions were about 
orlncloals* Interest In sut)-isrouDS test data, preferences for particular formats for test 
reports and additionally desired information. The final question asked principals how 
much they felt test data reflects what is Important In schooling. Copies of the questions 
used are located In Appendix A. 

Post-interview, The final section of the protocol consisted of questions for the 
Interviewer (which were completed as soon as possible after the interview). This sheet 
had five comment areas— key themes, areas of concern, areas of confusion, personal 
reflections and suggestions for future Interviews (see Appendix B). 

The Subject Population 

Twelve districts were selected for participation In the study to represent a range 
of socio-economic status levels, diversity with regard to ethnic composition, and a range 
of district sizes. Within each district, three principals and three board members were to 
be randomly selected for interviews. This paper focuses on the subsampie of 27 board 
members who participated in the study. 

Interview Procedures 

Staff from the UCLA Center for Research on Evaluation, Standards, and Student 
Testing (CRESST) and directors of district research and evaluation offices were recruited 
and trained in study procedures. Training included discussion and practice In the use of 
the interview protocol as well as directions for randomly selecting respondents, and 
taping, summarizing and returning completed Interviews. Interviewers then used the 
protocol to obtain data. 

Each Interviewee was first contacted by phone and asked to be Involved In the 
study. Most Interviews took approximately a half hour. All the Interviews were tape 
recorded. The Interviews were all conducted between May and September, 1989. 

Interviewers summarized the results of their Interview as soon as possible after 
each Interview. Both the Interviews summaries and tapes were turned over to the 
MLES staff. The MLES Staff then coded and analyzed the results. 

Analysis of the Data 

Tape Interviews were summarized and a code book was assembled and tested by 
four coders. Formal ceding did not begin until there was one hundred percent 
agreement on eight test Interviews. 

For the study reported In this paper simple frequencies were tabulated. Small 
sample sizes precluded analyses based on contextual variables and likewise limit the 
generallzabillty of results. 

Results 

Who were the School Board Respondents? 

The respondents. Interviews were completed with 27 school board members 
from a total of ten school districts. The obtained sample was fairly evenly distributed 
between those who were new to their school board roles (less than two years on their 
boards); those who and an Intermediate level of experiences; and those whom we 
considered veteran school board members (six or more years on the board. See Table 1 
In Appendbt C). 



Their school district context. Based on state definitions, two of the ten 
districts represented are classified as large city school systems, two as small school 
districts, and the remaining eight as mid-sized districts. 

While the communities served by the districts are varied In SES levels, the 
majority are characterized on average as mid-level SES, with about one-quarter low SES 
and a single district serving a high SES community. The communities served are 
ethnically diverse. 

The most recent results of the California Assessment Program give a sense of the 
achievement context In which our respondents operate. More than 40 percent serve 
in districts where students score below the state average In reading and In math. 

In summary, although the respondents and their districts were mostly from 
Southern California, we believe they generally represent the typical district in the 
state. It should be noted, however, that dearly absent from our study are small rural 
districts. 

What Key Information Sources Are Used to Assess School Quality? 

Table 2 and Graph 1 (see Appendix C) show the sources of Information school 
board members most frequently mentioned In evaluating the quality of their schools. 
Note that although almost all respondents mentioned testing as an important source, 
only about half were familiar enough with testing to be able to name a specific kind of 
test (e.g., CAP, state assessment, etc.). 

The results In Trble 2 and Graph 1 show a dear preference by school board 
members for qualitative, informal sources of information, often gained interpersonally. 
Consistent with both their often political roles and their positions as community 
liaisons, they reiy heavily on feedback from parents, the community and the media. 
Su Jh feedback apparently often comes on a "catch as catch-can* basis (e.g,, 
conversations with checkout derks, Interactions during sodal gatherings, etc.). For 
example, as one veteran board member put It, "I get a lot of Information In the grocery 
store, on the street, from people who work in the district who would talk to me off the 
record and away from their Job site." 

School board members also highly value their own observations of classrooms and 
schools. Mentioned by almost three-quarters of our respondents, this source also was 
the most likely of any source mentioned to be considered critically important and 
heavily weighted In evaluations of school quality: 

The highest priority is going to a school— and checking the environment— the 
facult>' and students and see how they ;^re doing in the classroom. 

In some ways what IVe found to be most valuable Is the one-on-ones that I have 
as a board member out In the schooIs...prlmariIy with students, with teachers, 
with administrators and observatlons...It's a real valuable source of Information 
because so often, the information doesn't filter all the way to the board without 
that link. 

You see the kinds of effort the teachers are putting Into their classrooms and I 
think that says a lot. If the classrooms are vibrant, and a lot of activity on the 
board— I think that's a good indicator that things are happening. 

Many school board members, In addition, appear to rely highly on the opinions 
of professionals In their districts. Almost three-quarters depend on the superintendent 
or other district administrators for perspectives on school quality- As mentioned later in 
this paper, many appear highly dependent on the school professionals to summarize 



and interpret data for them. One board member noted, "As far as numbers, I couldn't 
tell you whether being in the 60th percentile Is okay or t.ot. I have to rely on seasoned 
administrators. Including principals." In contrast, a small, vocal minority is highly 
skeptical of information and opinions offered by their school district staffs. 

Drop-out rates, student grades, and results of special competitions and awards are 
valued by a sizeable minority of respondents. Relatively few pay attention to other 
more formal and quantitative information sources (e.g., attendance rates, teacher 
turnover, results of college entrance exams, fonnal surveys). It is of interest to note the 
low frequency of formal survey data, even though surveys were routinely administered 
In several of the sampled districts. 

How Do School Board Members Judge Quality? 

Ba.<.»d on test scores. Almost all respondents queried claim that they make 
determinations of school quality by looking for trends over time (see Table 3). Scores 
going up indicate that their schools are doing well, while scores going down indicate that 
there are problems. Said one Board member, "If we've gone up, hopefully we've done 
the right thing. If we've gone down...lots of things could account for this. 

Respondents generally seemed to have difficulty, however, in articulating how 
large a change actually indicated progress in either direction. Even those who were able 
to articulate specific criterion, however, did so only tentatively, as this veteran's 
comment indicates: "If we made anywhere from between a 10 to 20 percent jump each 
year— I think I'd be real happy...that's a guess." 

Also common, reported by about three-quarters of board member respondents, is 
the use of the normative standard of how other schools or districts are performing. 
Board members check to see whether their students' scores are ab^jve, below, or even 
with Similar schools or districts. As one board member put it, "Of course you look at test 
scores and compare one school with other similar ones to see if you're living up to 
expectations." 

About half the respont'ints judge quality by looking to see whether students are 
scoring at or above the national or state average or whether they are "on grade level. 
This criterion may be less used than the above two because of where students In the 
sampled districts currently score. Recall that over 40% of respondents serve in districts 
which score below the state average on CAP. They perhaps achieve a sense of progress 
and success— and/or can convey such a vision publicly— by looking for improvement and 
relative accomplishment. 

It is of interest to note that few respondents, less than 20%, evaluate the quality 
of their schools in relation to specific expectations or goals (e.g., students scoring at 
ypedfic levels; students mastering specific goals). Criterion-referenced interpretations 
or performance related goals are generally not In board members' vernacular. 

Based on personal observations of schools and classrooms. In making 
judgments about the quality of their schools, board members were about equally divided 
among those who did and did not claim to be assessing relatively specific aspects of the 
school setting. Consistent with the interpersonal orientation mentioned earlier, the 
most commonly observed aspect was school climate, as evidenced by the quality of 
interactions among and between students and teachers. Also commonly mentioned 
were teacher morale, teaching methods used In classrooms, and perceived student 
involvement in dasswork (e.g., Interest, attention). About one-fifth of the responded 
also paid some attention in their observations to classroom management and control 
Issues. The flavor and variety of alterla used are evident in these comments: 
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I expect to see cooperation between teachers. I expect to see classiooms where 
students are attentive and arc learning. I don't expect to hear a lot of non- 
school related noise— the playgrounds are well supervised, the lunch shelters are 
well organized and the kids are under control. 

Relatively infrequent were those who claimed to pay attention to physical 
characteristics— the appearance of teachers, classrooms, or school grounds; the 
presences of specific instructional resources. Also rare were those who paid attention to 
the nature or quality of student work products or instructional content (see Table 4 and 
Graph 2). 

How Do School Board Memben Make Sense of the Evaluation Reports They 
Receive? 

While a majority of school board members report sautinizing the reports they 
receive, an even larger number report seeking help from others to help them 
understand and interpret the findings. One board member was very frank on this issue: 
"In a nutshell, I rely a lot on management to help me understand. After all, as a trustee 
I don't know your job or other testers' job out there so I rely on that kind of information 
and support." 

About a half are looking for aberrations as they peruse findings (e.g., data that 
doesn't conform to general patterns, findings that somehow jump out from the page). 
Or as one put it, "I look for something that is really out of whack," 

About a third are looking to answer specific, although largely idiosynaatic, 
questions, e.g., how does school x in my region compare to school y? how many 
students scored above grade level? Has the proportion gone up? how did students 
perform in higher level skills? (See Table 5) 

In contrast to principals' use of results, less than a third are specifically looking for 
areas of strength or weaknesses and only a couple mentioned that results were directly 
linked to calls for programmatic changes. Board members also were relatively less 
interested In subgroup performance. While almost two-thirds were interested in 
breakdowns of results by ethnicity, only about one third volunteered interest in specific 
results of limited English proficient students, and only about ten percent expressed 
interest in gender differences or differences by program category (see Table 6). 

What Are School Board Members Preferences for Reporting? 

Content of Reports- The great majority of school board members had little to 
add when asked what additional information would be helpful to them. However, a 
significant minority, 20 to 25%, expressed interest in additional information, including 
quantitative indicators such as attendance rates and drop-out rates; and better 
information about school climate (see Table 7). 

A slightly larger proportion also were interested in additional analyses that might 
contribute to their decisionmaking. Over a third wanted analyses that would help them 
compare the effects of different instructional programs, and about a quarter each 
wanted analyses that would let them see relationships between performance and 
student demographics and answer spedflc policy or practical questions. 

Format of Reports. Results regarding format indicate the difficulty of pleasing 
everyone. While half the respondents prefened graphical displays, about a third each 
listed tables or nanativc as favored modes of communication (see Table 8 and Graph 3). 

Whatever the format, however, brevity appears to be the valued characteristic. 
Among reactions were: 
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Wei!, the first thing that pops !nto my head is that they are usually boring. I 
read the executive summary and that makes sense to me, and 1 suppose th2* it's 
just the nature of the beast that a lot of numbers are boring. 

A small, concise report— four or five pages at the most. 

Forty percent volunteered their desire for brief executive summaries of findings. 
However, because only ten percent wanted less technical Information, It appears that 
while board members desire the findings digested for them, many also want to 
credibility of the full technical data. 

Implications and Conclusions 

The results of the interviews carry both good news and bad news for those 
concerned with the use of information and Its effects on educational policy and 
program Improvement. 

Good news. First, the findings help to allay some of the concerns of those who 
have reservations about the value of standardized testing and who worry about over- 
reliance and misuse of test results. The results clearly Indicate that for most school board 
members such worries are misplaced. Most school board members claim to be aware of 
the Imperfections of tests and judge the quality of their schools based on a broad array 
of Information sources. One board member put It this way: "I know our youngsters get a 
lot more out of school than, than Just test scores...so we can't go whole-hog on lust test 
scores. I know that. There's other good stuff out there.* 

In short, board members* judgments appear to reflect a balance of both 
qualitative and quantitative data, much of which is experlentlally based. Consistent 
with research in knowledge utilization (LIndblom and Cohen, 1979), school board 
members seem to lely on Informal working knowledge over formal information. While 
most do not appear to over-rely on test data, some do seem to accept unquestioningly 
any test results. 

A second potential source of good news concerns the working relationships 
between the ^rd members In the study and the education professionals in their 
respective districts. BDard members generally rely on district administrators— the 
superintendent, the research and evaluation director, school principals— for their 
information about the quality of schools and trust these individuals to interpret available 
data. A vocal minority, however, expresses great skepticism and distrust of their 
administrators* opinions Interpretations* Exemplifying this view was the comment, "I 
think that numbers can be put together In such a way that people are going to prove a 
prejudice or an Idea that they had." Members of this second group do not believe 
anything unless they see and process it for themselves. 

A third piece of good news which emerges from the findings is that relatively 
simple changes in reporting strategies could Inaease the utility of information for board 
members. For those districts or states who do not already do so, the addition of an 
executive summary would make evaluatlofi findings easier for board members to digest. 
"Keep it short* and "keep It simple" are two important dictums. Further, organizing such 
summaries (and the full reports) around the big questions which board members seek to 
answer would also be beneficial. The questions include: How are we progressing over 
time? How do our results compare with similar districts? How do our results compare 
with the national norm group? What are the implications of reported results for policy 
(areas of relative strength and weakness, differential performance by group or program). 

Differences in Board members* report format preferences preclude easy 
prescriptions. Backing executive summaries with technical data provided in all formats 
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(graphics, tabular, and full narrative) is one possibility for pleasing everyone, although a 
weighty one. Combining an executive summary with simple, visually clear graphical 
displays would probably please a majority, assuming that full technical data were 
provided as an appendix. The tension among differing preferences, however, may be a 
relatively short term problem as desktop technology becomes even more accessible for' 
all. For the future, technology-based reports could enable everyone to customize 
reporting to their own preferences for both organlzaHon and format without having to 
wade through endless pages to find an appropriate match. 

Bad news. A first note of bad news relates to informed consumerism., While 
most board members claim not to overemphasize test results, their knowledge and 
expectations for testing appear less than adequate. Only half of the respondents 
seemed to be aware that different kinds of tests were given in their district— at a 
minimum in these districts, the state assessment program and a norm-referenced 
commercial test. Most appeared to talk In the vernacular of norm-referenced tests, 
interested in whether students scored at or above grade level or at or above the national 
average, but almost none seemed to recognize that their goals were unrealistic given the 
nature of such tests. "If we're at the 50th percentile, being average Isn't acceptable to 
me.* Measurement experts know that all students cannot score above the national 
average, that all students cannot show progress relative to a national average, that ; 
scoring "at grade level" does not have a dear task or skill referent; Board members do 
not. If Board members are to seriously use test Infonnatlon, they need to be helped to 1 
become more critical consumers. I 

Some believe that education is best guided by a vision of what students should be ] 
able to do and accomplish; board members generally do not articulate such a vision or 
recognfze the weaknesses of available norm-referenced test information for evaluating 
progress toward such a vision. Further, board members' qualitative bases of information 
are largely idiosynaatlc, built on personal views of what constitutes a good educational 
program, a good school, a good climate, and drawn from relatively happenstance 
interactions and observations. While sudi perceptions certainly have face validity, the 
reliability of their samples are moot. Chance encounters at K-Mart check-out counters 
may or may not accurately represent the full reality. Further, the construct validity of 
board members judgments, particularly those derived from school and classroom 
observations, could be strengthened. Judgments could benefit from firmer grounding in 
research-based conceptions of educational quality and In research-based prindples of 
effective schooling and quality instruction. While dearly !t is unrealistic to expect 
Board members to be cunrent on the research, it is possible to envision training 
opportunities where Board members might refine what they look at/for as they observe 
and evaluate classrooms and schools. 

Attention to student performance is a prime candidate for emphasis should such 
opportunities occtu. What are students working on? What Is the nature of the tasks 
they are able to accomplish, the products they result in? Are these tasks and products 
meaningful, motivating, likely to require higher level thinking, likely to result in long- 
term learning? Board members as a group give little attention to such Issues. 
Articulating the important elements of a productive school dimate, given the attention 
board members pay to the dimate issue, appears another priority. 

Is it reasonable to expect school board members tv be more informed data users? 
Is it possible to help them become such users? The answer to both these questions Is 
'probably yes." But in the end, the worst news which emerges from the experience of 
Interviewing Is an answer to the question "Will such use make a difference for 
educational quality?" In taiking with Board members it seems dear that for most, the 
impact is likely to be marginal. Test scores and other data make a big initial splash when 
they appear In the newspaper or are brought to the Board. The splash may initiate 
consideration of the quality of education and how to Improve it, but the splash is 
generally short-lived as a board moves on to the myriad of other matters which come 
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before It. In fact, discussions of or agenda items related to educational quality are few 
and far between; board agendas appear swamped by the reality of approving consultant 
contracts for school workshops, for renovations, for new facilities and the like; and by 
the reality of maintaining status and position. In many of th? schools and districts we 
visited, the problems of surviving, of maintaining the bureaucracy, of maintaining one*s 
power, appeared to have displaced the primary goals of education. 

The use of data to improve schools assumes a largely rational, educational goals* 
based system. The technical problems of providing reasonable, useable data ^re 
tractable, and the results our interviews provide some feasible directions for their 
solutions. Assuring their impact on educational quality, however, will require continuing 
attention to larger socio-political issues. 
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CRESST Multilevel Evaluation Systems Project 
INTERVIEW PROTOCOL 

for School Board Members and School Principals 

May 9. 1989 



1. "Briefly, how do you know how good a job your school(s) are doing 
for students?" (List sources of Information mentioned, e.g., parent 
phone calls, newspaper artlcles/edltorlals, personal observation of 
schools, test scores, etc.) 

a. For each source mentioned, probe for how influential that source is in their 
judgment of their school(s) and why it carries that weight. ('You mentioned a 
number of sources of informatior, I'd lil<e to know a little more about how much 

importance you place in that source and why." How about . Would you say 

it's of overpowering importance, important, or only somewhat important? Why) 

b. If test scores are not initially mentioned, probe: "Do you use any test data?" (If 
no. probe for why not; if yes. probe for which specific ones are used) 

2 . )'d like to know a little more about how yon use this Information to 
judge your school(s). 

a. For eac/j source mentioned as important above, ask: 

If your schools were doing a good job. what would you expect to see in [the 
information source}?' 

What in [the information source] signals to you that there Is a problem or that 
some change is needed in your school/ district? 

b. Suppose there's some discrepancy between these various sources of 
information. For example, suppose you thought your math program was pretty 
good, but your math test scores are relatively low, what would you do/think? 

3. (Show district/school testing report) "There's a lot of Information 
in reports like this and not everyone who reads these reports goes about 

it in the same way. When y^jyi get a report like this, how do you attack it 
to make some sense out of It? What's the process /ou go through to find 
out what you want to know? 

/prode if necessary with questions such as: what's the first thing that gets your 

attention? And then what. Is there anything else that 

particularly draws your attention? What questions are you asking yourself as 
you review such reports?) 

4. When you look at Information such as this, are you interested In 
knowine* how different groups of students within the district perform? 
(e.g., how LEP students perform, how Hispanic, Black, Asian, Caucasians 
perfornfi, how girls vs. boys perform?) 
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a. If yes, wMph (ji j ^rouDS are of most interest to you? 



0. if yes, how i$ this information useful io you? 

5. Let's think a littt*^ more about the information that's presented in 
schooi/ district testing and evaluation reports. We're interested in 
knowing how to do this better. 

a. First, about how the information is presented. Reports like this typically 
include narrative text, data tables, graphs and the like. What's the easiest way 
for you to get information? 

Is there some part of this report that is particularly effective? 
What makes it effective? 

(Probe for format comments, e.g., are there any displays that you find 
particularly informative ?) 

b. Second, about what information is presented. Is there additional information 
about students, schools, or communities that you could like to see Included? Or 
things that are here that you would ]ust as soon see deleted? 

6. Would you say that test scores capture most of what's important \t\ 
schooling? [probe for whether it represents most of what's imporiant in 
students' academic achievement*] 

7. Any other comments or suggestions? 
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1) Summary of the informant's personal approach to school evaluation. 
(Use your own words to describe how you perceive the informant's actions 
and attitudes towards school evaluation.) 



2) Topic areas of concern for the informant (burning issues mentioned that 
relate or don't relate to the questions asked). 



3) Problems or confusion (the informant's lack of understanding of 
specific questions or your confusion about the informant's answer for a 
specific question) . 



4) Personal reflections on the interview and suggestions for future 
interviews. 



5) Emotional tone of interview (your feelings and your perception of the 
informant's feelings). 



I-ERJC 



6) Location: 

Time: \ ^ 

^ Environment (physical and social setting) : 
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Table 1: 


Background and Demographics 




2. 






School Board Members 




>, 






n 


t0 / 








C> w\ V* ^ / \ /7» 

EXpGriBnce 


% 


District 


% 


District 


% 






Size 




SES 




1 
1 


Beginning 18 


.5 


Small 


11.1 


Low 


25.9 


s 


Intermediate 22 


.2 


Medium 


74.1 


Mid-Level 


66.7 


i 

1* 


Veteran 3 3 


.3 


Large 


14.8 


High 


7.4 



IS 



Table 2; Sources of Information Used by 
School Board Members 
n = 27 


Sources % 


Informal Parent Input 
Sch/Class Observation 


79. 


9 


70. 


3 


Superint/Other Adm Input 


69. 


2 


Infonaal Stu Input 


55. 


5 


CoiMiunlty Input 


55. 


5 


CAP 


51. 


8 


Informal Teach Input 


48. 


1 


Norm Reference Tests 


44. 


4 


Newspapers 


42. 


3 


Principal Input 


38. 


5 


Grades 


33. 


3 


Dropout Rate 


33. 


3 


Awards 


25. 


9 


Discipline 


22. 


2 


College Prep Exams 


22. 


2 


Proficiency Tests 


18. 


5 


Teacher Turnover 


11. 


5 


Success - Next Level 


11. 


1 


Mobility Rate 


11. 


1 


Entries - Higher Level 


11. 


1 


Attendance Rate 


11. 


1 


Counselor Input 


7. 


7 


Formal Parent Input 


7. 


4 



GRAPH 1 



Sources of Information 
School Board Members 
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Table 3: How School Board 
Evaluate Test 
n = 27 


Members 
Scores 


% 


Trends Over Time 


88^5 


Compare Similar School 


73.1 


Grade Equivalency 


50.8 


Compare Personal Goals 


18.5 


Indiv Student Scores 


3.7 
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Table 4: Criteria for Classroom Observations 
School Boaird Members 



Criteria % 



School Climate 


48.1 


Student Involvement 


37.0 


leacner noraxe 


Z7 . O 


Teaching Method 


29.6 


Class Appearance 


22.2 


Class Management 


18.5 


Work Product 


14.8 


School Appearance 


14.8 


Class Resources 


11.1 


Instructional Content 


11.1 


Teacher Appearance 


7.4 


Lesson Plans 


3.7 
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Criteria for Classroom Observations 



School Board Members 



r 

5ch Atmosphere 
Student Invdv 
Teocher Maole 
Teoching Method 
Oass Appeal 
''loss Manogemt 
W(Tk Product 
Sch Appeor. 
Cioss Resa-rces 
Instr Cotitent 
i.:-0'Jv^f Appear p 

0 














■ 



"T" 
70 



^0 



T ■■ 

80 




100 



Table 5: How School Board Members 
Make Sense of Test Scores 
n = 27 



ACulVluy 




Seek Help 


70.4 


^oTiii" i ni 7fi RsDort 


55.6 


Look for Abberrations 


48.1 


Answer Questions 


33.3 


Skim Report 


33.3 


Look for Strengths/Weaknesses 


29.6 


Communicate Results to Others 


22.2 


Summarizes Report 


18.5 


Seeks Instructional Reform 


7.4 
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Table 6: Interest in Sub-Group 
Differences 



School Board Members 
n = 27 



Interest 



Ethnicity 59.3 

Limited English 36.0 
Social Economic Status 29.6 

Stereotype Misuse 14.8 

Gender 11.1 

Achievement 7 . 4 

other Programs 7.4 

General Interest 7.4 
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Table 7: Additional Information 






Wanted by Sch Board Members 


t 


n = 27 




I 


Information 


% 


\ 


Analysis of Test/Programs 


33*3 




Info on Individual Schools 


22.2 


%' 

Jr 
jS 


Analysis of Test/Demographics 


22*2 




Analysis for Policy Questions 


22*2 


V 


Descriptive Info on Test 


18*5 




Other Quantitative Indicators 


18,5 




School Climate Information 


14.8 




Prescriptive Information 


7.4 
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Table 8: Preferred Format 

School Board Members 
n « 27 


Format 


% 


Graphs 


48.1 


Executive Summary 


37.0 


Tables 


33.3 


Narrative 


30.8 


Better Keys 


14.8 


Less Technical Info 


11.1 



?8 
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